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ABSTRACT 

We investigate the S/N of a new incoherent dedispersion algorithm optimized 
for FPGA-based architectures intended for deployment on ASKAP and other 
SKA precursors for fast transients surveys. Unlike conventional CPU- and CPU- 
optimized incoherent dedispersion algorithms, this algorithm has the freedom to 
maximize the S/N by way of programmable dispersion profiles that enable the 
inclusion of different numbers of time samples per spectral channel. This allows, 
for example, more samples to be summed at lower frequencies where intra-channel 
dispersion smearing is larger, or it could even be used to optimize the dedispersion 
sum for steep spectrum sources. Our analysis takes into account the intrinsic 
pulse width, scatter broadening, spectral index and dispersion measure of the 
signal, and the system's frequency range, spectral and temporal resolution, and 
number of trial dedispersions. We show that the system achieves better than 
80% of the optimal S/N where the temporal resolution and the intra-channel 
smearing time are smaller than a quarter of the average width of the pulse across 
the system's frequency band (after including scatter smearing). Coarse temporal 
resolutions suffer a At~^/^ decay in S/N, and coarse spectral resolutions cause a 
Ai^~^/^ decay in S/N, where At and Au are the temporal and spectral resolutions 
of the system, respectively. We show how the system's S/N compares with that of 
matched filter and boxcar filter detectors. We further present a new algorithm for 
selecting trial dispersion measures for a survey that maintains a given minimum 
S/N performance across a range of dispersion measures. 
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Subject headings: methods: observational — surveys — instrumentation: detec- 
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Introduction 



The dispersive nature of the plasma that pervades interstellar and intergalactic space 
causes the observed arrival time of impulsive astrophysical radio signals to be strongly fre- 
quency dependent. In cold plasmas the dispersive delay is proportional to DM, where 
the dispersion measure, DM, is the line-of-sight electron column density. The effects of dis- 
persion are particularly manifest in searches for pulsars and short-timescale transients at 
long wavelengths (A > 0.1m) with sufficient sensitivities to detect objects at large distances. 
This applies to several current and planned high- sensitivity surveys on next-generation radio 
telescopes, which are being conducted in the regime in which the effects of interstellar, and 
potentially intergala ctic, dispe rsion are extrem e (e.g. the LOFAR Tran sients Key Proiect ; 



Stappers et al. 



HTRU survey 



2011 



CRAFT, 



Keith et ahlboiol : 



MacauartI 



2011 



Arecibo PA LFA Survey; ICordes et all 12006 



Burke-Spolaor et al.ll201ll ) 



The effects of dispersion smearing are in principle fully reversible if the electron column 
through which the radiation propagated can be determined. However, a number of practical 
factors prevent complete recovery of the signal to the same strength as an undispersed 
pulse. For the process of incoherent dedispersion, in which the signal is recoristruc ted from a 
filterbank of intensities gridded in time and frequency ( Cordes fc McLaughlinllioOS ). there are 
three primary means by which the S/N is degraded. 1. The finite resolution of the filterbank 
limits the S/N of the dedispersed signal when there is residual dispersion smearing across 
the individual filterbank channels (i.e. when the dispersive delay across the bandwidth of the 
channel exceeds the temporal resolution). 2. Finite computational power limits the number 
of DM trials that can be searched in a survey, resulting in a loss of sensitivity to events with 
DMs in between trials. 3. The signal is smeared over a large number of temporal bins, whi ch 
degrades the signal strength in the presence of system noise (jCordes fc McLaughlin! |2003| ) . 



The process of coherent dedispersion (IHankins fc Rickettlll975l ). in which the raw signal 
voltages recorded from the antenna are convolved with the inverse of the transfer function 
of the dispersive medium, achieves the optimum S/N recovery of the dispersed signal by 
eliminating effects 1 and 3. However, for the purposes of conducting blind surveys for one- 
off transient events, the data- and compute-intensive nature of coherent dedispersion renders 
it too slow to be practical with present technology. 



The technique of incoherent dedispersion offers a viable alternative when processing 
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resources are limited. Incoherent dedispersion is the mainstay of rnost current pulsar sea rch 



and transients survey detection algorithms (e.g. JWayth et al.ll201ll : iTer Veen et al.ll201l[ ). A 
complete understanding of its performance is crucial to understanding the optimal dedisper- 
sion strategy when computational resources are finite. For instance, if a real-time detection 
system can only dedisperse the signal at a fixed number of trial dispersion measures, what is 
the optimal choice of trial DMs? A related problem is to quantify the effect of a given dedis- 
persion strategy on the completeness statistics of the survey. Though these are old questions, 
the answers have acquired a renewed urgency because t hey are needed t o inform the design 
of next generation surveys for impul sive signals fe.g.. iD'Addarid |2010| ). These questions 



have been addressed in the past (e.g.. ICordes fc McLaughlinll2003l ). but without addressing 



the degrading effects of implementing boxcar templates as opposed to true matched filters, 
and only considering a general approach to analysing the effects of temporal and spectral 
resolution, and DM error. The optimization of blind surveys for pulsars and transients is 
particularly pressing in the context of SKA time-domain system design, where extreme data 
rates make offline data storage impractical in many instances, and necessitate real-time pro- 
cessing of the data stream. These factors influence SKA system design and drive backend 
hardware processing requirements, which can comprise a sizable fraction of the total cost of 
the instrument. 

Incoherent dedispersion techniques h ave been emp loyed for several decades. An early 
technique, known as the tree algorithm ( Taylorl Il974l ). consists of a regular structure of 
delay and sum elements that transforms an input signal of frequency channels to N 
dedispersed output signals, with 0(A^log2A^) operations. While the tree algorithm is a 
process-efflcient technique and has been popular, particularly in early pulsar surveys, it has 
some draw-backs that limit its sensitivity: a) it assumes that signal dispersion is linear 
with frequency, b) the dispersion measures for each of the dedispersed outputs are flxed to 
linear distributions from (no dispersion) to the DM at which the gradient of the dispersion 
curve is one temporal bin per spectral channel (thus called the "Diagonal DM"), and c) each 
dedispersed output sample is the sum of only one sample from each of the channels of 
the dynamic spectrum. Addition al processing stages are often employed to mitigate some 
of these limitations: for example, [Manchester et al.l (l200l[ ) linearize dispersion by inserting 
artiflcial ("dummy") channels between the real frequency channels, and then divide the 
linearized data into smaller groups of adjacent channels, or sub-bands, before dedispersing 
each sub-band using the tree algorithm; and a broad distribution of trial DMs is achieved 
by successively summing the data samples in pairs and repeating the dedispersion process. 

Another algorithm called DART (a Dedisperser of Autocorrelatio ns for Radio Tran- 
sients) used in the V-FASTR transient detection system for the VLB A fjWayth et al.l 1201 if ) 
arranges samples of the signal's dynamic spectrum into vectors, one vector per frequency 
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channel, with each vector containing a time series of samples of up to several seconds. The 
vectors are then skewed with delay offsets appropriate to the trial DM, then summed to 
produce the dedispersed time series for that trial. In many ways the DART algorithm is 
more flexible than the tree algorithm: It supports an arbitrary number and distribution 
of trial dispersion measures, and it supports arbitrary dynamic-spectrum dispersion curves, 
including curves proportional to A^. However, it too sums only one sample from each input 
channel to produce each dedispersed output sample. 

A new transients detection system called Tardis is being developed fo r the Commensal 



Real-time ASKA P Fast Transients (CRAFT) survey (IMacquart et al.ll2010l ). For this system 



D'Addarid (120 lOl ) describes a dedisperser that can, for each output sample of a given trial, 
sum dynamic spectrum samples from multiple temporal bins per spectral channel. Thus, 
for large DMs where pulse power can be distributed over many temporal bins per spectral 
channel, additional dynamic spectrum samples can be included in the sum to improve the 
S/N of the dedispersed output. The Tardis implementation of this system (Clarke et al., in 
prep.) allows arbitrary sets of dynamic spectrum samples to be selected for the dedispersion 
sums for each trial. The samples of each set are selected a priori depending on the DM, pulse 
width and spectral index assumed for the trial. The pulse width can include the signal's 
intrinsic width and also temporal broadening of the signal due to interstellar scattering. 
Equal weight is given to all samples in each trial sum. 

In this p a per, w e examine the S/N performance of the fast transients detector proposed 



m 



D'Addarid (120101 ) and implemented in Tardis, and we present a sample selection algorithm 
aimed at maximizing the S/N of each dedispersed output signal. While matched filter detec- 
tors perform weighted sums of signal samples, with weightings determined by assumed pulse 
profiles, we show that our new detector yields comparable performance using unweighted 
sums. In the second part of the paper, we use the new detector to describe how performance 
is affected by the temporal and spectral resolutions of the system, the magnitude of disper- 
sion and DM error. We use these results as tools with which to decide how to choose the 
optimal balance of resources for a given system (spectral and temporal resolution, and trial 
DMs), extending previous work in these areas to form concrete recommendations for system 
design with dynamic spectrum detectors. 

In ^ we define the problem and specify the Tardis dedispersion algorithm mathemati- 
cally. The S/N reduction associated with finite temporal and spectral resolution is examined 
in ^ and in §4] we examine how the S/N reduces with increasing dispersion measures. In 
§S] we compare the performance of the new algorithm with that of time-series and dynamic 
spectrum matched filters, and the traditional boxcar filter. Then in ^we study the residual 
temporal smearing due to differences between trial DMs and true dispersion measures of 
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signals (i.e. DM errors), how these errors impact the S/N performance, and present a new 
algorithm for selecting trial DMs to maximize the completeness of fast transients surveys. 
Our conclusions are outlined in §71 



2. A dynamic spectrum fast transients detection system 



In this section we exa mine the S/N per formance of the incoherent fast transients de- 
tection system outlined in iD'Addarid (120 lOf ) and advance an alternative sample selection 
algorithm that aims to maximize the S /N performance. 



2.1. Dedispersion fundamentals 

Consider a pulse whose intrinsic emitted power per unit bandwidth is of the form, 

P.{t,i.) = Po(j^^ fit), (1) 

where Pq has dimensions WHz~^, a is the spectral index of the pulse and f{t) is a dimen- 
sionless function that describes the intrinsic pulse profile. is the energy received per unit 
time per unit bandwidth at a given time t and frequency z/|^ 

Interstellar dispersion introduces a delay in the signal arrival time of an amount = 
DM/ku"^, where the dispersion measure (DM) is the integral of the electron density along the 



propa gation path of the signal, and k = 2.41 x 10 pc.cm ^.s is a constant (IHankins fc Rickett 



19751 ). Furthermore, multipath propagation, or scattering, in the interstellar medium can 



cause broadening of the temporal width o f the signal, a nd diffractive and refractive scintil 



lation modulations of the signal intensity (lRickettlll990l ) 



Scattering is highly dependent on the signal frequency, and on the direction and distance 
of the source in a manner that strongly correlates with dispersion measure. We model scatter 
broadening as a convolution in time (denoted by an asterisk) with a general scattering 
impulse response function, hd [t; u, DM), hd is dimensionless and as temporal smearing due 
to scattering involves no attenuation in signal power, its area is unity, {hd approaches the 
dirac delta function in the limit of no scattering.) 



^Formally cannot be treated as a continuous function of both time and frequency to arbitrary precision 
in both quantities, since time and frequency are dual parameters connected via the Fourier transform. 
However in practice, in the regime where Av At ^ 1, eq. ^ is an excellent approximation to a continuous 
function because the discretization is on a much finer scale. 
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Scintillation causes deep (up to 100% of the mean) amplitude modulations in time and 
frequency. Scintillation time scales are generally too large to be relevant to detecting fast 
transients. The only instance in which frequency modulation plays an important role is 
where the decorrelation bandwidth is comparable to the observed bandwidth; larger modu- 
lations affect all frequencies within the observed bandwidth equally, and smaller modulations 
average-out across the band. Optimization of the S/N subject to the effects of scintillation is 
prohibitive in a computationally limited system, because scintillation is a stochastic process 
with multitudes of possibilities that compound an already large parameter space. For this 
reason we choose not to include scintillation in our model. 

Considering dispersion and temporal smearing due to scattering, our model for the 
observed power per unit bandwidth is 

P.,obs(t, y) = Po / - ^) * (t; z/, DM) . (2) 

The average power received over temporal and spectral intervals [t, t + At] and [z/, v + Az/] 
respectively is 

P{t, ^) = ^ y du' y dt' P,,obs(t', i^'). (3) 

In digital systems, the dynamic spectrum of a signal is quantised in frequency and time 
into discrete samples. If we assume that the time dimension is quantised to a resolution of 
At and that frequency is quantised into channels of Au, then each sample represents the 
average power within a At-hj-Au cell of the dynamic spectrum, as illustrated in Figure [1] 
Each sample includes contributions from the signal, i.e. the dispersed pulse, and noise from 
the sky and the receiver. Thus if sample s represents the average power in the cell [ts,ts + 
At] Vsi '^s + Au], then sample s would have a value of P{ts, t^s) + -P/v(^s; i^s), where the former 
term is the average power of the pulse within the cell (as modeled in eq. ([3])), and the latter 
term is the average noise power within the cell. 



The system described by iD'Addarid (120101 ) involves summing selected samples of the 



dynamic spectrum, where samples are selected based on their relative time t and frequency 
u, and on the dispersion measure, pulse width and spectral index assumed for the trial. We 
will consider how to select the samples in the next section. For now, assume that S is the set 
of samples selected to dedisperse the signal for a given trial. The pulse component (ignoring 
noise) of the time series output of the dedisperser for that trial can be modeled as 



Pdedisp[n] = ^ P{ts + n At, Us), Vn G Z. 



(4) 
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Fig. 1. — Defining points of interest in determining the dedispersed output time series for a 
trial. 



For the purposes of detecting astronomical pulses, we aim to maximize the dedispersed 
signal power relative to statistical variations in the noise power. Our figure of merit is 
therefore the signal-to-noise ratio (S/N) calculated as a ratio of Pdedisp to the noise error 
(i.e. the standard deviation of the noise). The uncertainty principle implies that the product 
of the temporal and spectral resolution cannot be less than unity, and in this paper we 
assume that Au At ^ 1 such that the central limit theorem holds and the noise contribution 
to each sample can be assumed to be normally distributed. To simplify our analysis, we 
ignore self-noise generated from the signal; self-noise is typically small compared with sky 
and receiver noise. Using the radiometer equation, the noise error in a cell of bandwidth Au 
and interval At can be modeled as 



k Tgyg Au 



(5) 



where k is Boltzmann's constant and Tsys is the system equivalent noise temperature. Gen- 
erally, Tgys is a frequency dependent parameter that represents the overall noise temperature 
of the system, including natural radio emissions from the sky and gain fiuctuations in the re- 
ceiver electronics; however, variations in system temperature are often relatively small across 
the operating bandwidth of the receiver, and for the purposes of the analyses in this paper 
we assume that Tgyg is constant with frequency. Since the noise is normally distributed, the 
average total noise power after summing the samples for a given trial is 



cr. 



(6) 



VAuAt 

where is the number of samples in set S. The dedispersion process therefore produces a 
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S/N ratio given by: 

Smn] = ^^^^ = . (7) 



2.2. Sample selection for maximum Signal-to-Noise Ratio (S/N) 



Assume that we have a set of samples S for dedispersing our signal, and consider the 
possibility of adding another sample, ^, to our set. If we were to include this sample, then 
the new dedispersed signal power would be: 

Pdedisp[n] = Pdedisp[n] + P{t^ + n At, i/J, (8) 

and the new dedispersed noise error would be: 



a. 



VNs + 1 



- sys 



VAz/At 



■ a. 



^dedii 



(9) 



The ratio of the new S/N to the old would then be: 

/ 

1 



SNR[n] 



dedisp 



[n] a, 



ride 



SNR[n] Pdedisp[n\ a. 



'^dedisp 



\ 



P{ts + n At, Us 

s&,Sy^i; 



I 



(10) 



On average, we improve the overall S/N by adding sample <^ to our sum when eq. ([10 
is greater than unity. That is, when: 



P{t^ + n At, v^) > 



^^^-l) E P{ts + nAt,Us). 



(11) 



Eq. (fTTl) provides a criterion for adding a new sample (?) to an existing set of samples 
(S) used in the dedispersion sum for a given trial. We use this criterion to select, a priori, sets 
of dynamic spectrum samples to be summed by the dedisperser for each trial. The P{t, u) 
terms, on both sides of the relation, are predicted using eq. ([3]) and the DM, pulse width 
and spectral index parameters targeted for the trial. The discrete time offset, n, controls the 
time at which a dedispersed pulse will appear at the output of the dedisperser relative to 
the time that the corresponding dispersed pulse arrives at its input, and is therefore chosen 
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to minimize the dedispersion latency and the amount of physical storage required within the 
dedisperser. 

The set of samples that maximizes the S/N may not be unique. To achieve the maximum 
S/N with the fewest samples, we recommend the following procedure: Beginning with an 
empty set, include a sample that has the highest average signal power (as predicted using 
eq. (IH])), then add successive samples in order of highest average signal power until eq. (fTTl) 
is no longer satisfied. 



3. S/N variation with temporal and spectral resolution 

In this section we look at how the signal-to-noise ratio performance of our fast transients 
detection system varies with temporal and spectral resolution. We show that systems em- 
ploying finer resolutions generally achieve better S/N performance than systems employing 
coarser resolutions, but there is a sweet spot beyond which finer resolutions yield smaller 
S/N gains. 

To simplify the analysis we assume that the scatter broadened pulse has a rectangular 
profile and that rather than using the procedure described in §2.21 to select samples, set 
§ includes any sample that includes a non-zero component of signal power. That is, S 
includes any sample, s, for which P(ts + nAt, z/^) > 0. The signal power for each sample 
is predicted using eq. ([3]), the DM, intrinsic pulse width, scatter broadening and spectral 
index parameters targeted for the trial, and an arbitrary discrete time offset, n = uq. We 
have already shown that the S/N can be improved by excluding some samples with small, 
non-zero amounts of signal power, so the following analysis will use a less than optimal value 
for the S/N, but this is fine for the purposes of exploring the effects of resolution on the 
S/N and later in this section we will see how the more rigorous sample selection algorithm 
improves the S/N. 

Figure [2] illustrates the profile of the dispersed, rectangular pulse defining the samples 
of set §. Here we define and to represent the earliest and latest times at which 
the pulse appears in channel c, respectively. If we define Uc to be the highest frequency 
within channel c, then we have t^^ = DM/kz/^, and ~ t^^ + r' {uc, DM) + Atc. Note 
that the approximation for ts^ assumes that r' {uc, DM) is approximately constant across the 
frequency band for channel c, which becomes less accurate with coarser spectral resolutions^ 
The Atc term is the dispersion smearing time of the signal across channel c, which can be 



^Note that temporal broadening is strongly dependent on frequency (e.g. ly ^ with 3.5 < x < 4.4). 



approximated as Arc ~ 2 DM Az//k z/^. Thus, if all samples containing non-zero signal power 
are included in §, then the total number of samples in S is 
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Fig. 2. — Sketch of the template dispersed, rectangular pulse (shaded) used to specify the 
dedispersion set S. The square cells represent the samples belonging to §. Each sample 
includes a non-zero amount of pulse power, and all of the pulse power within bandwidth /3 
is collectively included in the samples of S. 



If a dispersed pulse matching our prescribed profile is input to this dedisperser, then, 
by design, the peak S/N will occur aX n = uq and will be 

SNRfn 1 = ^o/^^ [i V r^""^ du' (-\ 

^"""^ kT,y, VAuAtNs [P " Vo) 

A derivation for eq. ( !T3|l is given in Appendix |X1 It can be shown that for large numbers 
of frequency channels, i.e. C ^ 1, the term in brackets in eq. fll3p converges to a constant, 
and for the remainder of this analysis we assume that this term has little influence on how 
the peak S/N varies with spectral resolution. However, note that this assumption does not 
hold for spectrally steep signals at coarse spectral resolutions, because under these conditions 
the bracketed term can vary significantly with C. 



(13) 



For brevity we define 
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which is the maximum S/N that the system would achieve if it had infinitely fine resolution 
and if there were no scatter broadening. With scatter broadening, the maximum S/N atten- 
uates with (t/t^^,)^^^, where r^^ is the average scatter broadened width of the pulse across 
the system bandwidth, /3. Thus, we define the maximum scatter broadened S/N as 

I 1 

SNR'o = SNRo J ^ , where r^^ = - ^ r' (z/,; DM) . (15) 

We also define the nominal spectral resolution 

-1 

(16) 

which is the spectral resolution at which the average intra-channel smearing time (i.e. the 
average of Atc over all channels) equals the average scatter broadened pulse width, r^„. Note 
that the term in brackets in eq. ( fT6l) is a function of the number of spectral channels, C, and 
converges to a constant for large C. 

With these definitions, we now examine the effects of spectral and temporal resolution 
on the peak S/N using the approximations in equations (fT2|) and ( IT3|) . We consider nine 
cases, one for each combination of "fine", "nominal" and "coarse" resolution in frequency 
and time, and for each case the reductions of equations f ll2p and fll3p are captured in Tabled] 

In Table [1] we show that the peak S/N converges to the optimal value, SNRq, at fine 
temporal and spectral resolutions; drops down to SNRq/2 at nominal resolutions; then decays 
proportional to At~^/^ and Ai/~^/^ at coarse resolutions. Note that while the condition for 
nominal spectral resolution is the same across all temporal resolutions, the conditions for 
nominal temporal resolution vary with the spectral resolution, from At ~ r^^ at fine spectral 
resolutions. At ^ 2 r^^ at nominal spectral resolutions, to At ^ Au/ Auq at coarse spectral 
resolutions. These conditions are consistent in that each represents the temporal resolution 
at which the peak S/N is l/\/2 of the value it would be at an infinitesimally fine temporal 
resolution. 

In the special case where both the temporal resolution and the average intra-channel 
smearing are limited to some arbitrary multiple of the pulse width. At = Av. [Atc] = mr^„, 
i.e. At/r'^^ = AvjAv^ = m, we have 

iV§ ^ (2 + 1/m) C and SNRH ~ ■ (17) 

Vl + 2m 

For example, for rectangular pulses, S/Ns greater than 82% of optimal (0.82 SNRq) can be 
achieved when the temporal resolution and intra-channel smearing are less than a quarter 
of the averaged scatter broadened pulse width (m < 0.25). 
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2 DM 
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Table 1: Effects of temporal and spectral resolution on S/N. 
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_ SNRJ, /ah) 
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At > ^^'^ 
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So far we have used a simple and intuitive means of estimating the S/N. The surface 
plot in Figure [3] justifies this by showing how the peak S/N varies with the spectral and 
temporal resolution of our system when employing the sample selection algorithm described 
in §2.2[ One sees that the curve conforms with the characteristics described in the above 
analysis. The sample selection algorithm slightly improves the S/N predicted in the above 
analysis, and in this case the relative improvement in S/N is at a maximum of ~20% at the 
nominal resolution point. 

Tableland Figure [3] show that significant improvements in S/N performance can be 
realized by increasing the resolution of a system from coarse to nominal regimes, but also 
that progressively less S /N improvement can be achieved as the resolution increases beyond 
nominal. Finer resolutions generally come at the cost of higher data volumes and faster 
processing, and these costs need to be weighed against the improvement in performance and 
overall science goals of the survey. 

4. S/N variation with dispersion measure 

The S /N performance of an incoherent dedispersion system also depends on the disper- 
sion measure of the trial. This dependence can be seen from the relations in Table [1] By 
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Fig. 3. — A surface plot of the dedispersed S/N as a function of temporal and spectral res- 
olution. The surface points are numerically calculated using the sample selection algorithm 
given in §2.21 for a frequency range of 700 MHz to 1 GHz, an intrinsic pulse width of 1 ms, 
a spectral index of 0, a dispersion measure of 30 pc.cm"^ and neghgible scatter broadening 
(such as for an extra-galactic fast transients survey away from the galactic plane). The 
hatched region identifies where the temporal-spectral resolution product falls below unity 
and the analysis is no longer valid. 



rearranging the relations in the left-hand column of Table [H the table becomes a description 
of the S/N for nine regions of DM vs At space. Thus, for a given spectral resolution, the 
DM dimension is divided into "low" (DM < DM^), "nominal" (DM ^ DM^) and "high" 
(DM ^ DM^) dispersion measures, where 



DM^ 



2 Az/ 



- c-i 



-1 



,-3 



c=0 



Similarly, by replacing the normalized Az/ axis with a normalized DM axis (DM/DM,-), 
the surface plot in Figure [3] serves to illustrate the variation in S/N with dispersion measure. 

DM,- is the dispersion measure at which the average intra-channel smearing time equals 
the average width of the scatter broadened pulse. At DMs larger than DMt-, intra-channel 
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smearing losses start to become significant, causing the S/N to decay proportional to DM~^/^. 
Intra-channel smearing lo ss is a common problem for all incoherent dedispersion systems 
( iHankins fc Rickettlll975[ ) and such systems often require finer spectral resolutions in order 
to target larger dispersion measures without significant loss in S/N. 



5. Comparison with matched filters 

We now compare the performance of the Tardis dedisperser detector to the performance 
of (i) detectors commonly employed for fast transient and pulsar detection, and (ii) theo- 
retically optimal detectors. The Tardis dedisperser detector operates on power samples in 
time and frequency space (the dynamic spectrum), whereas conventional fast transient de- 



Wavth et al. 


2OI1I; 


Deneva et al. 


2009) 



consider detectors operating in both the dynamic spectrum (time and frequency samples) 
and temporal (time samples alone) domains. 

The matched filter detector (MF) is the optimal linear detector for data with generalized 
Gaussian noise, and operates on the dataset with a replica of the signal profile. When the 
signal profile is unknown, approximate templates can be evaluated to optimize detection 
performance. The major disadvantage of the MF is the need for knowledge of the pulse 
profile. One method of avoiding this issue is to consider a simple boxcar template (specifically, 
a unit height rectangular pulse with variable width, typically binned geometrically): this 
detector will have sub-optimal performance compared with the MF for signals that are not 
rectangular and/or of differing temporal width compared with the tem plate. The boxcar 



template has been employed in recent fast transients experiments (e.g., IWayth et al.l 12011 



Deneva et al.l 120091 ). 



In addition to comparing the Tardis dedisperser detector with the time series boxcar 
detector, we also wish to compare its performance with optimal detectors: the matched 
filter applied in both the temporal (time series dataset), and dynamic spectrum (time and 
frequency dataset) domains. The former represents the best-case detector when data are 
averaged over spectral channels, and the latter represents the best performance achievable 
with dispersed dynamic spectrum data. Throughout we consider white Gaussian noise, 
although this is not necessary for the method (knowledge of the noise properties is required, 
however), and assume that the pulse timing is optimal (pulse arrival aligns with the beginning 
of a sample, and is known: in general, this is determined empirically). We also omit any 
contribution to the noise power from signal self-noise, because this is typically small compared 
with the power contribution from the sky and receiver. This simplification allows us to treat 
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the noise as an additive quantity. 



We now use the first and second order statistics of the detection test statistic ( lKaylll998[ ) 
to derive expressions for the signal-to-noise ratios for each of these detectors, and discuss 
the key differences and similarities between them. 

Time series matched filter (MF): Noting that the matched filter multiplies the data 
by a replica of the expected pulse profile (yielding a square in the following expression), the 
signal power and noise error are, respectively: 




(19) 



an 



Nt 



C 



\ j=l \c=l 




(20) 



yielding, 



SNR 



MF 




(21) 



where Nt denotes the number of temporal samples, and C is the number of spectral chan- 
nels. The number of samples in the MF denominator is 



y/NtC > viV§, because the 
Tardis detector does not have to use all of the spectral channels. This can lead to the MF 
incorporating more noise power than is optimal if one had the full dynamic dataset (the 
MF presented here is optimal in the time-series domain). Therefore, the performance of the 
two detectors depends on the nature of the signal being detected, and consequently, on the 
spectral and temporal resolution of the experiment. 



Dynamic spectrum matched filter (DSMF): 



SNR 



DSMF 



Nt C 

EE^'fe. 

j=l c=l 



/cTsysVAz/ 



(22) 



For this detector, all included samples are summed in quadrature. This detector weights each 
sample according to the expected signal strength, reducing the effective noise contribution 
to the test statistic. The obvious drawback to implementation is the requirement for full 
knowledge of the pulse shape. 
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Time series boxcar detector (Box.): 



Aft C 



This expression is similar to that for the Tardis detector, with the major difference that it 
is forced to include all of the noise power over the spectral channels. For finite temporal 
and spectral resolution, and DMt^O, < C Nt, and the Tardis detector will always yield 
improved performance compared with the boxcar MF. Note that this also considers box- 
car templates that are optimally matched to the actual signal pulse width: in the general 
case, when the pulse width is unknown, the boxcar template will not be matched, and the 
performance will be further degraded. 

For a perfectly dedispersed pulse (where Ns = C Nt and P{t,v) = P), it is straight- 
forward to show that all detectors yield the same S/N. It is obvious from these expressions 
that the Tardis dedisperser detector is a width-optimized boxcar detector in the dynamic 
spectrum domain (the sample inclusion/exclusion criterion provides the width optimization). 

Figure H] displays the detection performance for each detector as a function of the nor- 
malized spectral resolution, Au/Auq. The two matched filter detectors perform well, with 
the DSMF performing the best across the range tested, as expected. The Tardis dedisperser 
detector performs well relative to the time series matched filter. At low Au/Auq (high res- 
olution), the time series matched filter performs better. This reflects the Tardis detector's 
binary choice for either including or excluding samples: while excluding a sample may retain 
a higher S/N, signal power is nonetheless excluded (rather than being optimally- weighted, as 
for the time series matched filter). At very poor resolution, the two curves cross: the dedis- 
persed signal is substantially broadened at low resolution, and the additional noise power 
incorporated into the time series matched filter degrades its performance. 

The time series boxcar detector has variable performance, depending on how well- 
matched the coarse temporal bins are to the underlying signal. We have chosen a single 
possible realization of its performance. Its performance matches that of the others at high 
resolution, when the pulse width is matched perfectly to a tested bin width, and the start 
of the pulse aligns with the start of the bin. 

The matched filters, for both the time series and dynamic spectrum domains, demon- 
strate superior performance compared with the Tardis detector, for a wide range of system 
and signal parameters. Matched filters are, however, difficult to implement in practise, given 
the need for full knowledge of the signal profile - a major obstacle for fast transients surveys. 
On the other hand, boxcar filters, implemented in either the time-series or dynamic spectrum 
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SNR versus frequency resolution 
At^ 




0.30 J . . . ^ . . . ^ . . . ^ 
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Fig. 4. — Detection performance signal-to-noise ratios, relative to an un-dispersed rectangu- 
lar pulse, for the Tardis detector, and three other common detectors. 

domains, are blind to pulse shape, and suffer performance degradation accordingly (note that 
the Tardis dedisperser detector is further superior to some time-series implementations [e.g., 
VFASTR], because it does not use a base-2 discretized temporal binning to produce the trial 
templates). The Tardis dedisperser detector presented here attempts to balance the perfor- 
mance/signal knowledge trade-off, by exploiting the performance advantages of working in 
the dynamic spectrum domain and with a sample-selection criterion, to offset performance 
loss due to lack of pulse shape knowledge. In addition, the Tardis dedisperser detector is 
computationally efficient to implement, requiring only summing of samples (compared with 
matched filters, which perform weight and sum operations). 
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6. Survey completeness 

In our analyses so far we have assumed that the dispersion measure of the received 
signal is known. However, dispersion measures vary with distance from the source and the 
content of the intervening ISM along the line-of-sight to the source, and when surveying 
the sky for new sources, the dispersion measure applicable to each received transient is 
generally unknown. It is therefore necessary for the system to dedisperse the signal using a 
range of trial dispersion measures and search each dedispersed signal for transient content. 
Real-time dedispersion and detection processes are compute-intensive, and the computation 
power increases linearly with the number of trial dispersion measures. As we will see, the 
number of trials and the distribution of those trials across the range of dispersion measures 
targeted by the survey are critical design choices; they determine the completeness of the 
survey in terms of the average S/N performance. In this section we describe how a set of 
trial dispersion measures can be chosen to maximize the completeness of a fast transients 
survey. 



6.1. Pulse broadening due to DM error 



We begin by illustrating how differences between the dispersion measure assumed for a 
given trial and the actual dispersion measure of an observed pulse can cause the resulting 
dedispersed signal t o be broadened in time. Temporal broadening due to DM error is a well 
documented effect JSurns fc Clarklll969l : Icordes fc McLaughliiJ[2003l : IP'Addariolboioh and 
for completeness we review this in the context of the models presented in this paper. 

Assume that the set of samples, §, is chosen to maximize the dedispersed S/N for 
signals that have a dispersion measure equal to the trial DM, DMtriai, and assume that we 
attempt to dedisperse a signal whose actual dispersion measure, DM, differs from the trial 
DM, i.e. IDM ^ DMtnai- The dedispersed S/N would be: 



SNR[ri] 



At 



n At, Us, 'DM) 



sen 



N^Au 



(24) 



sys 



The ratio of eq. ([7]) and eq. flMl) gives the "relative" S/N for a signal whose DM does 
not equal the trial DM: 



^P(t, + n At, z/,,i5m) 



SNR,e,M 



SNR[n] 

SNR[n] ~ ^p(t, + nAt,z/„DMtnai)' 



(25) 



s6£ 
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Using the sample selection criterion outlined in §2.21 for determining S, and the relation 
for the relative S/N in eq. fl25|) . the profiles for a series of test pulses, each with differing 
dispersion measures, are plotted in Figure E] for a trial DM of 30 pc.cm"'^. These exam- 
ples are calculated for signals received in the 700 MHz to 1004 MHz frequency band, with 
1 MHz channel resolution and square-law detected samples integrated to a temporal resolu- 
tion of 1 ms. Each dispersed pulse input to the dedisperser is modeled using eq. ([3]) with a 
rectangular scatter broadened pulse profile of width 1 ms. 
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Fig. 5. — Dedispersed pulse profiles for a range of dispersion measures about a trial DM of 
30 pc.cm"^. The system bandwidth ranges from 700 MHz to 1004 MHz, with 1 MHz channel 
resolution and 1 ms temporal resolution. The scatter broadened profiles of the input pulses 
(prior to dispersion) are identical: rectangular with width 1 ms. 



The plots show how pulses become increasingly smeared as the differences between the 
trial and actual DMs increase. The visible asymmetries in the dedispersed pulses, more 
notable for those with larger absolute DM errors, are a consequence of the natural z/~^ 
bend in the dispersion curve. If the actual DM of the pulse is less than that of the trial, 
then the trial will initially intersect the dispersed pulse in the low frequency channels, and 
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the point of intersection will progress to the higher frequency channels as the trial sweeps 
past the dispersed pulse. Since both the trial and the pulse are more dispersed at lower 
frequencies, the leading edge of the resulting dedispersed pulse is more extended than its 
trailing edge. The converse occurs for pulses with DMs larger than that of the trial: as 
the trial sweeps past the dispersed pulse, the point of intersection moves from high to low 
frequency channels, causing the trailing edge of the resulting dedispersed pulse to be more 
extended than its leading edge. 



6.2. S/N variation with DM error 

The temporal broadening of a pulse due to the difference between its true dispersion 
measure and a given trial DM (i.e. the DM e rror) reduces the S/N of the dedispersed signal 
for that trial. ICordes fc McLaughlin! (120031 ) shows that, in general, temporal broadening 



reduces the S/N according to 



SNR, 

snr: = vi^' 



where Wi and SNRj are the temporal width and S/N of the "incident" pulse (i.e. before the 
pulse is broadened), and Wb and SNRf, are the temporal width and S/N of the broadened 
pulse. If we consider Wi to be the width of the pulse after it has been dedispersed to a 
perfectly matched trial DM, such that there is no DM error, then Wi can be approximated 
using 



W, ^ /\tl^r■es^dual + + (27) 

and if W^ is the width of the pulse after it has been dedispersed to an un-matched trial DM, 
with a DM error of (5DM, then 



A^DMresiduai + ^t^DM + + T^^, (28) 

where AtoMresiduai is the component of the pulse width due to residual dispersion smearing 
(that which cannot be corrected for by dedispersion) ; At^DM is the component due to the DM 
error, 5DM; and as defined earlier. At and r^^ are the temporal resolution of our dedispersion 
system and the average scatter broadened width of the pulse, respectively. 

For coherent dedispersion systems, the residual smearing after dedispersion is essentially 
zero (i.e. ^t-oMresiduai = 0). However, incoherent dedispersion systems can only remove inter- 
channel smearing; the residual (intra-) channel smearing can be approximated as 

2DMAi/ 

AtoMresiduaZ ~ ^ • (29) 
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The component of smearing due to DM error, AtsDU, is equivalent to the smearing of 
a signal with a dispersion measure equal to 5DM across the entire frequency band, /3. This 
smearing can likewise be approximated as 

At^DM ~ T^. 30 



By substituting these approximations back into eq. (126|) it follows that 

-1/4 



SNRfe 
SNR, 



C2 5DM2 



diag 



+ 1 



(31) 



where DM^jag is known as the "diagonal DM", i.e. the DM at which the average smearing 
time across each channel equals the temporal resolution; and DM^- is the DM at which the 
average smearing time across each channel equals the average width of the scatter broadened 
pulse. 
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(32) 



Using the approximation given in eq. ( I5T]) . Figure E] illustrates how the S/N attenuates as 
the DM error increases. The DM error is normalised to a value of ^ y^DM^ + DM^^^^ + DM^, 
which implies that for sufficiently small dispersion measures, DM ^ DM^^j^g? or DM ^ 
DM,-, the S/N attenuation for a given DM error is independent of the dispersion measure; 
whereas for sufficiently large dispersion measures, DM 2> DM^^j^g and DM ^ DM^, the S/N 
attenuation for a given DM error is expected to be less for larger dispersion measures. With 
greater scatter broadening, the normalisation value increases, which means that although 
the overall S/N (SNRj) reduces with scatter broadening, DM errors cause less attenuation 
in the relative S/N. 



6.3. Choosing trial dispersion measures 

To maximize the average S/N performance of our detection system across all signals 
within the DM range of our survey, we aim to choose a set of trial DMs that maintains a 
limited S/N attenuation between trials. We do so by constraining the relative S/N to some 
minimum constant value 

i|> (33) 
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Fig. 6. — Attenuation of dedispersed S/N with increasing DM error. The ordinate is nor- 
mahsed to the dedispersed S/N expected when there is no DM error, i.e. when the trial DM 

matches the true DM of the signal. The abscissa is normalised to ^ wDM^ + DM^^^^ + DM^. 



where e is referred to as the DM error factor. It can be shown that this constraint is equivalent 
to limiting the temporal broadening due to DM error to At^DM < ^Wi. 

By substituting the approximation for the relative S/N given in eq. (13T]) into eq. (133|) 
we can show that the DM error needs to be constrained to 

<5DM < ^ y/DM^ + DML^ + DM^. (34) 

Therefore, given some arbitrary limit to the reduction in S/N that we are prepared to 
accept between trial DMs (i.e. (e^ + 1) ^^^), and noting that we can space our trial DMs at 
intervals of 2 6DM, we can choose a set of trial dispersion measures that adhere to this limit 
as follows: 

„ n—l 

DM. = DMo + 5^ y^DM^ + DM^, + DM^, (35) 

i=0 
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where DM,, Vz G [0, 1, — 1], are the dispersion measures chosen for our set of trials, 
with each successive subscript denoting a successively larger dispersion measure. DMq can 
be set to the minimum dispersion measure in the range to be searched, and each successive 
trial DM can be calculated from the trial DMs preceeding it using eq. (1351) . 

It follows from eq. (135!) that where the trial DMs are small, i.e. where DM„ ^ DM^iag 
and DM„ ^ DM,-, and where scatter broadening is either insignificant or independent of the 
DM, the DM error (5DM) is approximately constant and the trial DMs are approximately 
uniformly (linearly) spaced, i.e. 

2en 



DM, ^ DMo + ^jBMi^^ + BMi. (36) 

But where the trial DMs become dominant (i.e. DMj ^ DMdiag and DM^ ^ DM,-, for some 
j < n), the trial DMs become approximately exponential with n, i.e. 

DM^^DM,- ( 1 + — j . (37) 

For coherent dedispersion systems, since there is no channelization and consequently 
no residual intra-channel smearing, the DMj terms disappear from the right-hand side of 
eq. (1351) and the trial DMs follow a linear spacing where scatter broadening is small or 
constant with DM, and become more spread-out at higher DMs where scatter broadening 
becomes significant. Therefore generally more trial DMs are needed for coherent dedispersion 
systems than for incoherent dedispersion systems. 

Figure [7] demonstrates how the choice of trial DMs can impact the S/N performance for 
the Tardis fast transients detection system planned for the CRAFT survey. CRAFT aims to 
survey the sky for milli-second-scale transients from both galactic and extra-galactic sources 
by making use of ASKAP's wide (30 degree^) field of view. Given the high luminosities o f 



recently detected extra-galactic fast transients (e.g.. iLorimer et al.ll2007l : iKeane et al.ll201ll ). 
it is reasonable to expect that Tardis may detect source s to redshifts of 2; < 3, implying IGM 
dominated dispersion measures up to ~3000 pc.cm"'^ (jlnoudl2004l ). Thus a range from 10 



to 3000 pc.cm ^ is targeted for CRAFT, which the Tardis system intends to cover with 442 
trials. 



The plot in Figure 7(a) shows the S/N performance where those 442 trials are distributed 
using the relation given in eq. ( 135|) . The S/N consists of a series of finely spaced peaks and 
troughs, where at the peaks, the true dispersion measure of the pulse matches a trial DM, 
and at the troughs, the true dispersion measure falls in the middle of two adjacent trial DMs. 
Note the relative drop-out, i.e. the ratio of the S/N of a trough to the S/N of its adjacent 
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peaks, is constant across the full range of dispersion measures. The DM error factor in this 
case is 1.492, giving a S/N drop-out between trial DMs of about 0.75 relative to surrounding 
peaks. Also note the general DM"^''^ attenuation in S/N discussed above in §U 



We compare the plot in Figure 7(a) with the plot in Figure 7(b) where the same number 
of trials are exponentially distributed across the DM range. Here we see that the exponential 
distribution packs trials unnecessarily tightly at low dispersion measures, leaving fewer trials 
available for higher DMs and overall poorer average performance across the entire range. 





Dispersion Measure of received signal 



Dispersion Measure of received signal 



(a) Trials distributed using eq. ((35 



(b) Exponentially distributed trials 



Fig. 7. — Plot of the normalised maximum dedispersed S/N as a function of the dispersion 
measure of a 1 ms test pulse. In this example, the system bandwidth ranges from 700 MHz 
to 1 GHz, with 1 MHz channel resolution and 1 ms temporal resolution. The S/N is the 
maximum across all trial DMs and normalised to a value of Pq \/ P t /kTsys- A total of 442 
trial DMs are distributed from 10 to 3000 pc.cm"'^ using: (a) the relation given in eq. (135|1 . 
with a DM error factor of e 
ratio of 0.013. 



1.492; and (b) exponentially distributed trials, with a trial 



It is well known that dedispersion systems with larger numbers of channels (i.e. finer 
spec tral resolutions) require more trial DMs to achieve the same S/N drop-out between tri- 
als (IHankins fc Rickettlll975l ). and this can be seen from the dependence on C in eq. (135|) . 



Essentially, systems with coarser spectral resolutions suffer more significant intra-channel 
smearing, making them less sensitive to DM error than systems with finer spectral resolu- 
tions. This is demonstrated in Figure [8] for a putative high radio frequency (21 to 23 GHz) 
survey for milli-second pulsars at the Galactic Center where dispersion measures as high as 
^2000-5000 pc.cm"^ can be expected. For the purposes of this example we consider DMs 
in the range 50 to 10,000 pc.cm"'^. Two possibilities are plotted: In (a), the band is di- 
vided into 256 channels of 7.8125 MHz, and in (b), the band is divided into 32 channels of 
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62.5 MHz. Each target the same number of trial DMs (128), but to do so, the finer spectral 
resolution example must suffer a higher DM error factor. This can be seen in the plots as 
slightly larger drop-outs between trial DMs: In (a), troughs are 93% of the peaks; while in 
(b), troughs are 98% of the peaks. The underlying cause of this is that at high DMs the 
system with coarser spectral resolution (b) suffers from significant intra-channel smearing, 
making it less sensitive to DM error than the finer spectral resolution system. Consequently, 
for the plot in (b), the trial DMs can be more spread-out at high DMs, and more compact 
at low DMs, resulting in shallower troughs between trial DMs. On the other hand, the finer 
spectral resolution system suffers less S/N degradation due to intra-channel smearing and is 
therefore able to maintain higher overall S/N performance at high dispersion measures. In 
terms of survey completeness, the finer spectral resolution example is preferable since it has 
a higher average S/N over the DM range. 
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Fig. 8. — Plots of the normalised maximum dedispersed S/N as a function of the dispersion 
measure of a 100 fis test pulse. In both plots, the system bandwidth ranges from 21 GHz 
to 23 GHz, with 100 /is temporal resolution and spectral resolutions of (a) 7.8125 MHz (256 
channels), and (b) 62.5 MHz (32 channels). The S/N is the maximum across all trial DMs 
and normalised to a value of Pq a/ Pr/kTsys- In both total of 128 trial DMs are 

distributed from 50 to 10,000 pc.cm"^ using the relation given in eq. (l35l) and with DM error 
factors of (a) e = 0.580, and (b) e = 0.287. 
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7. Conclusions 

In this paper we liave examined the signal-to-noise performance of a new incoherent 
dedispersion algorithm that improves on the performance of traditional algorithms by sup- 
porting multiple temporal bins per spectral channel in the sum that forms the dedispersed 
time series for a given trial. The algorithm has the freedom to include (or exclude) any sam- 
ple of the dynamic spectrum in its dedispersion sum, thus providing a crude mechanism for 
matching the profile of a pulse without the computational expense of weighting each sample. 
Even without sample weights, the new algorithm displays comparable S/N performance to 
the ideal matched filter (both time-domain and dynamic spectrum matched filters) and im- 
proved performance over traditional time-series boxcar filters. Critical parameters affecting 
S/N performance include the system temperature, frequency range, and spectral and tem- 
poral resolutions of the system, the ranges of pulse widths and dispersion measures targeted 
for the survey, and the number and distribution of trial dispersion measures across the DM 
range. Given an assumed pulse profile and dispersion measure for a trial, application of the 
sample selection criterion presented in this paper ensures that the S/N of the dedispersed 
time series is optimized with a minimal number of samples. The paper has demonstrated 
that significant improvements in S/N performance can be achieved for moderate increases in 
resolution when both the temporal resolution and the average intra-channel smearing time 
are approximately equal to the target pulse width. Progressively less S/N improvement can 
be achieved as the resolution increases beyond this nominal resolution point, and at coarser 
resolutions the S/N diminishes with At~^/^ and Ai^~^/^. Once a suitable system resolution 
has been identified, the number and distribution of trial dispersion measures can be deter- 
mined, and the paper has presented a new trial DM selection algorithm designed to maintain 
a predefined minimum relative S/N performance across the targeted range of DMs. 
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many and various comments and suggestions. The Centre for All-sky Astrophysics is an 
Australian Research Council Centre of Excellence, funded by grant CE110001020. The 
International Centre for Radio Astronomy Research (ICRAR) is a Joint Venture between 
Curtin University and the University of Western Australia, funded by the State Government 
of Western Australia and the Joint Venture partners. 
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A. Peak dedispersed S/N for rectangular pulses 

We derive an expression for the peak dedispersed signal-to-noise ratio for pulses that 
have rectangular scatter broadened pulse profiles: 

fit; u, DM) = = [H(t) - H(t - t\u; DM))] ^^^^'^^^y (Al) 

where / is the intrinsic pulse profile, hd is the impulse response function for scatter broaden- 
ing, H(t) is the Heaviside function, r is the intrinsic width of the pulse, and r'(z/; DM) is the 
pulse width after scatter broadening. The fractional term on the right of eq. ( lAll) accounts 
for proportional attenuation of the pulse intensity with scatter broadening. For this profile, 
the average power of the dispersed pulse in the dynamic spectrum bounded by the temporal 
and spectral limits [t, t + At] and [u, v + Az/] is 

^'-> = s/r-'(0"7"""-K''-s^)-"(''-"-s)]7^ 



Substituting eq. flA2p into eq. ([7]) gives an expression for the S/N of the ra*'^ sample of 
the dedispersed time series: 
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(A3) 



where S is the set of A§ dynamic spectrum samples chosen for the dedispersion sum. If at 
n = uq the dedisperser receives a pulse whose profile precisely matches the assumed scatter 
broadened pulse profile modelled in eq. ( lAll) . then the samples of set § will collectively 
include all of the pulse power and the sum on the right of eq. (1A3I1 will equate to the scatter 
broadened pulse width, r', leaving 
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Note that the term in brackets converges to a constant for increasing numbers of channels 
(C), and for suitably small channel bandwidths (Az^), can be approximated by 
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